INFORMATION 
one SCIENCES 


1976 


Ax International Journal 


Contents: 


B. G. BATCHELOR (Southampton, England) 
Artificial Data for Pattern Recognition 


DAVID B. BENSON (Pullman, WA) 
Life in the Game of Go 


JOSEPH D. COLE (Louisville, Kentucky) 
and ANDREW P. SAGE (Charlottesville, Virginia) 
On Assessment of Utility and Worth 
of Multi-Attributed Consequences in Large-Scale Systems 


CRAIG M. COOK, AZRIEL ROSENFELD, 
and ALAN R. ARONSON (College Park, Maryland) 
Grammatical Inference by Hill Climbing 


ANTHONY EPHREMIDES (College Park, Maryland) 
Linear Innovation Theorems 


EDWARD T. LEE (Stony Brook, New York) 
An Application of Fuzzy Sets to the Classification 
of Geometric Figures and Chromosome Images 


D. KAZAKOS and P. PAPANTONI-KAZAKOS (Houston, Texas) 
Moments and Error Expressions 
in Polynomial Minimum Mean Square Estimation 


J. DENNIS LAWRENCE and J. DENBIGH STARKEY (Pullman, WA) 
Experimental Tests of 
Resolution-Based Theorem-Proving Strategies 


ANUPAM N. SHAH and AZRIEL ROSENFELD (Falls Church, VA) 
Two Heads Are Better Than One 





© American Elsevier Publishing Company, Inc., 1976. All rights reserved. 





C. H. CHEN (North Dartmouth, Massachusetts) 
On Information and Distance Measures, 
Error Bounds, and Feature Selection 


D. TJOSTHEIM and J. B. THOMAS (Princeton, New Jersey) 
On a Class of Nonstationary Random Processes 


ARUNABHA BAGCHI (Enschede, The Netherlands) 
A New Martingale Approach to Kalman Filtering . 


EUGENE SANTOS (Youngstown, Ohio) 
Fuzzy Automata and Languages . 


ANASTAS A. FARJO (Baghdad, Iraq) 

and TZAY Y. YOUNG (Coral Gables, Florida) 
Analysis and Design of Decision-Directed Learning 
Schemes Using Stochastic Approximation . 


DANIEL P. PETERSEN (Albuquerque, New Mexico) 
Linear Sequential Coding of Random Space-Time Fields. 


DEMETRIOS G. LAINIOTIS (Amherst, New York) 
A Unifying Framework for Linear Estimation: 
Generalized Partitioned Algorithms . 


TOSIYASU L. KUNII (San Jose, California) 
DATAPLAN: An Interface Generator for Database Semantics 


FRANCESCO ROMANI (Pisa, Italy) 
Cellular Automata Synchronization . 


ART LEW (Honolulu, Hawaii) 
Optimal Control of Demand-Paging Systems . 


EUGENE S. SANTOS (Youngstown, Ohio) 
Fuzzy and Probabilistic Programs 


Y. EDMUND LIEN (Lawrence, Kansas) 
A Note on Transition Systems . 


Author and Subject Indexes to Volume 10 





Author Index to Volume 10 


Aronson, Alan R. 
(see Cook, Craig M.), 59 


Bagchi, Arunabha 
(A New Martingale Approach to Kal- 
man Filtering), 187 

Batchelor, B. G. 


(Artificial Data for Pattern Recognition), 


l 
Benson, David B. 
(Life in the Game of Go), 17 


Chen, C. H. 
(On Information and Distance 
Measures, Error Bounds, and Feature 
Selection), 159 

Cole, Joseph D. and Sage, Andrew P. 
(On Assessment of Utility and Worth 
of Multi-Attributed Consequences in 
Large-Scale Systems), 31 

Cook, Craig M., Rosenfeld, A., and Aron- 
son, Alan R. 
(Grammatical Inference by Hill Climb- 
ing), 59 


Ephremides, Anthony 
(Linear Innovation Theorems), 81 


Farjo, Anastas, and Young, Tzay Y. 
(Analysis and Design of Decision-Di- 
rected Learning Schemes Using 
Stochastic Approximation), 199 


Kazakos, D. and Papantoni-Kazakos, P. 
(Moments and Error Expressions in 
Polynomial Minimum Mean Square 
Estimation), 115 

Kunii, Tosiyasu L. 

(DATAPLAN: An Interface Generator 
for Database Semantics), 279 


Lainiotis, Demetrios G. 
(A Unifying Framework for Linear 
Estimation: Generalized Partitioned 
Algorithms), 243 


363 


Lawrence, J. Dennis, and Starkey, J. Den- 
bigh 

(Experimental Tests of Resolution-Based 

Theorem-Proving Strategies), 131 

Lee, Edward T. 
(An Application of Fuzzy Sets to the 
Classification of Geometric Figures 
and Chromosome Images), 95 

Lew, Art 
(Optimal Control of Demand-Paging 
Systems...), 319 

Lien, Edmund Y. 
(A Note on Transition Systems), 347 


Papantoni-Kazakos, P. 
(see Kazakos, D.), 115 

Petersen, Daniel P. 
(Linear Sequential Coding of Random 
Space-Time Fields), 217 


Romani, Francesco 
(Cellular Automata Synchronization), 
299 
Rosenfeld, Azriel 
(see Cook, Craig M.), 59 
Rosenfeld, Azriel 
(see Shah, Anupam N.), 155 


Sage, Andrew P. 
(see Cole, Joseph D.), 31 
Santos, Eugene 
(Fuzzy Automata and Languages), 193 
Santos, Eugene S. 
(Fuzzy and Probabalistic Programs), 
331 
Shah, Anupam, and Rosenfeld, Azriel 
(Two Heads are Better Than One), 155 
Starkey, J. Denbigh 
(see Lawrence, J. Dennis), 131 


Thomas, J. B. 
(see Tjostheim, D.), 175 

Tjostheim, D., and Thomas, J. B. 
(On a Class of Nonstationary Random 
Processes), 175 


Young, Tzay Y. 
(see Farjo, Anastas A.), 199 





Title Index to Volume 10 


Algorithms, Estimation; 
Generalized Partitioned Linear (Lainiotis), 243-280 
(Lainiotis), 243-280 Mean Square (Kazakos et al.), 115-130 
Analysis Error Bounds 
(of Learning Schemes) (Chen), 159-175 
(Farjo et al.), 199-216 Error Expressions 
Application, (Kazakos et al.), 115-130 
Fuzzy Sets (Lee), 95-114 Experimental Tests 
Approximation, (Lawrence et al.), 131-154 
Stochastic 
(Farjo et al.), 199-216 Feature Selection 
Artificial Data (Chen), 159-175 
(Batchelor), 1-16 Fields, 
Assessment Random Space-Time 
(Cole et al.), 31-58 (Petersen), 217-242 
Automata, Filtering, Kalman 
Fuzzy (Santos), 193-198 (Bagchi), 187-192 
Automatic Synchronization Fuzzy Automata 
(Romani), 299-318 (Santos), 193-198 
Fuzzy Programs 
Cellular Automata Synchronization (Santos), 331-346 
(Romani), 299-318 Fuzzy Sets 
Chromosome Images (Lee), 94-114 
(Lee), 95-114 
Class of, 
Random Processes 
(Tjostheim et al.), 175-186 
Classification, 
Geometric Figures 
Chromosome Images 
(Lee), 95—114 
Coding 
(Petersen), 217-242 


Game of Go 
(Benson), 17-30 
Generalized Partitioned Algorithms 
(Lainiotis), 243-279 
Geometric Figures 
(Lee), 95-114 
Go, 
Game of (Benson), 17-30 
Grammatical Inference 


Data, Artificial (Cook et al.), 59-80 


(Batchelor), 1-16 


Database Semantics Heads, 
(Kunii), 279-298 Multi-Head Automata 


Dataplan (Shah et al.), 155-158 

(Kunii), 279-298 Hill Climbing 
Decision-Directed Learning Schemes (Cook et al.), 59-80 

(Farjo et al.), 199-216 
Demand-Paging Systems Image, 

(Lew), 319-330 Chromosome (Lee), 95-114 
Design (of Learning Schemes) Innovation Theorem 

(Farjo et al.), 199-216 (Ephremides), 81-94 
Distance Measures Interface Generator 

(Chen), 159-174 (Kunii), 279-289 


364 





Kalman Filtering 
(Bagchi), 187-192 


Languages 

(Santos), 193-199 
Large-Scale Systems 

(Cole et al.), 31-58 
Learning Schemes 

(Farjo et al.), 199-216 
Linear Estimation 

(Lainiotis), 243-280 
Linear Innovation Theorems 

(Ephremides), 81-94 
Linear Sequential Coding 

(Peterson), 217-242 


Martingale Approach 
(Bagchi), 187-192 
Mean Square Estimation 
(Kazakos et al.), 115-130 
Minimum Mean Square 
(Kazakos et al.), 115-130 
Moments 
(Kazakos et al.), 115-130 
Multi-Attributed Consequences 
(Cole et al.), 31-58 


Nonstationary Random Processes 
(Tjostheim et al.), 175-186 


Optimal Control 
(Lew), 319-330 


Pattern Recognition 
(Batchelor), 1-16 


Polynomial 
(Kazakos et al.), 115-130 
Probabalistic Programs 
(Santos), 331-346 
Processes, Nonstationary Random 
(Tjostheim et al.), 175-186 


Random Fields 
(Petersen), 217-242 


Schemes, Learning 

(Farjo et al.), 199-216 
Semantics, 

Database (Kunii), 279-298 
Sequential Coding 

(Petersen), 217-242 
Space-Time Fields 

(Petersen), 217-242 
Stochastic Approximation 

(Farjo et al.), 199-216 
Strategies, 

Theorem-proving 

(Lawrence et al.), 131-154 

Synchronization 

(Romani), 299-318 
Systems, 

Demand-Paging (Lew), 319-330 

Large-Scale (Cole et al.), 31-58 

Transition (Lien), 347-362 


Theorem-Proving Strategies 
(Lawrence, et al.), 131-154 

Theorems, Linear Innovation 
(Ephremides), 81-94 


Unifying Framework 
(Lainiotis), 243-278 





Author Index to Volume 11 


Asher, Robert B., Sims, Craig S., and 
Sebesta, Henry R. 
(Optimal Open-Loop Feedback 
Control for Linear Systems with 
Unknown Parameters), 265 


Bang, S. Y. 

(See Ng, Peter A.), 223 
Breitbart, Y. 

(see Perl, Y.), 1 


Evans, James, Kersten, Paul and 
Kurz, Ludwik 
(Robustized Recursive Estimation 


with Applications), 69 


Gallagher, Raymond E. 
(See Richardson; John M.), 257 


Har-El, J. 
(See Rubinstein, Y.), 49 

Hawkes, Chris 
(See Haykin, Simon), 335 

Haykin, Simon, and Hawkes, Chris 
(Adaptive Digital Filtering for Co- 
herent MTI Radar), 335 

Hoffer, Jeffrey A. 
(An Integral Programming For- 
mulation of Computer Data Base 
Design Problems), 29 

Hofri, M., and Yadin, M. 
(Multiprogramming with Virtual 
Memory—A Queueing Model), 187 


Kazakos, D. 
(See Papantoni-Kazakos, P.), 309 
Kersten, Paul, and Kurz, Ludwik 
(Robustized Vector Robbins- 
Monro Algorithm with Applica- 
tions to M-Interval Detection), 121 


Kersten, Paul 

(See Evans, James), 69 
Kurz, Ludwik 

(See Evans, James), 69 
Kurz, Ludwik 

(See Kersten, Paul), 121 


Maurin, Jacques 
(Random Functions with Given 
Time Correlation), 141 

Meditch, J. S. 
(Initial-and Lagging-State Ob- 
servers), 55 

Milgram, David L. 
(“Real-Time” Equivalence of Cellu- 
lar Automata and Linear-Bounded 
Automata), 251 


Ng, Peter A., and Bang, S. Y. 
(Toward a Mathematical Theory of 
Graph-Generative Systems and its 
Applications), 223 


Omatu, Shigeru 
(see Tomita, Yutaka), 13 


Papantoni-Kazakos, P., and Kazakos, 
D. 
(The Limiting Density of a Nonlin- 
ear System), 309 

Perl, Y., and Breitbart, Y. 
(Optimal Sequential Arrangement 
of Evaluation Trees for Boolean 


Functions), | 
Perrault, Raymond C. 
(Augmented Transition Networks 
and Their Relation to Tree Trans- 
ducers), 93 
361 





362 


Richardson, John M., and Gallagher, 
Raymond E. 
(Linear Minimal Variance Estima- 
tion in Target Detection and Loca- 
tion), 257 

Rubinstein, Y., and Har-El, J. 
(About One of Tsetlin’s Problems 
of the Collective Behavior of 
Stochastic Automata), 49 


Sebesta, Henry R. 

(See Asher, Robert B.), 265 
Sims, Craig S. 

(See Asher, Robert B.), 265 


Soeda, Takashi 
(see Tomita, Yutaka), 13 


Tomita, Yutaka, Omatu, Shigeru, and 
Soeda, Takashi 
(An Application of the Information 
Theory to Filtering Problems), 13 


Vanderbrug, Gordon J. 
(Problem Representation and For- 
mal Properties of Heuristic Search), 
279 


Yadin, M. 
(See Hofri, M.), 187 





Title Index to Volume 11 


Algorithm, 


Robustized Vector Robbins-Monro 


(Kersten et al.), 121 
Automata, 
Cellular and Linear-Bounded 
(Milgram), 251 
Stochastic (Rubinstein et al.), 49 


Design Problems, 

Computer Data Base (Ho‘fer), 29 
Detection, 

M-Interval (Kersten et al.), 121 
Digital Filtering 

(Haykin et al.), 335 


Equivalence, 
“Real-Time” (Milgram), 251 
Estimation, 
Linear Minimal Variance 
(Richardson et al.), 257 
Robustized Recursive 
(Evans et al.), 69 
Evaluation Trees (Perl et al.), 1 


Feedback Control, 

Optimal Open-Loop (Asher), 265 
Filtering Problems 

(Tomita et al.), 13 
Functions, 

Random (Maurin), 141 


Heuristic Search 
(VanderBrug), 279 


Integer Programming Formulation 
(Hoffer), 29 


Limiting Density 
( Papantoni-Kazakos et al.), 309 


Model, 

Queueing (Hofri et al.), 187 
MTI Radar 

(Haykin et al.), 335 
Multiprogramming 

Virtual Memory (Hofri et al.), 187 


Networks, 
Augmented Transition 
(Perrault), 93 
Nonlinear System 
(Papantoni-Kazakos et al.), 309 


Observers, 
Initial- and Lagging-State 
(Meditch), 55 
Optimal Sequential Arrangement 
(Perl et al.), 1 


Problem Representation 
(VanderBrug), 279 


Robustized Recursive Estimation 
(Evans et al.), 69 


Systems, 
Graph-Generative (Ng et al.), 223 


Target 

Detection and Location 

(Richardson et al.), 257 

Theory, 

Information (Tomita et al.), 13 

Mathematical (Ng et al.), 223 
Time Correlation (Maurin), 141 
Transducers, Tree (Perrault), 93 
Tsetlin’s Problems 

(Rubinstein et al.), 49 








INFORMATION 
SCIENCES 





An International Journal 
EDITOR: John M. Richardson 


Volume 11, 1976 


NEW YORK 





Editor: John M. Richardson 


MARK AISERMAN 
Institute of Automatics 
and Telemechanics 
Academy of Sciences of 
the U.S.S.R. 
Profsejuanaja, 81 

Moscow V-485, U.S.S.R. 


A. M. ANDREW 

nt of Applied 
Physical Sciences 
University of Reading 
Whiteknights/Reading 
England 


MASANAO AOKI 
University of California 
Los Angeles, CA 90024 


KARL-JOHAN ASTROM 
Division of 

Automatic Control 

Lund Institute of 
Technology 

P.O. Box 725 

Lund 7, Sweden 


RICHARD BELLMAN 
University of 

Southern California 

Los Angeles, CA 90007 


FRANK B. CANNONITO 
University of California 
Irvine, CA 92664 


ROBERT FORTET 
Université de Paris VI 
Laboratoire de Calcul 
des Probabilitiés 

9, Quai Saint Bernard- 
Tour 56, Paris 5, France 


K. S. FU 

School of Electrical 
Engineering 

Purdue University 
Lafayette, IN 47907 


Electronics Research Division 
Rockwell International 

3370 Miraloma Avenue 
Anaheim, California 92803 


Editorial Assistant: PATRICIA RENFER 


Associate Editors 


JOHN GERDES 

Itek Corporation 

10 McGuire Road 
Lexington, MA 02173 


ANTONIO GRASSELLI 
Politecnico di Milano 
Instituto di Elettrotecnica 

ed Elettronica 

Piazza Leonardo da Vinci, 32 
20133 Milano, Italy 


RICHARD W. HAMMING 
Bell Telephone 

Laboratories Inc. 

Murray Hill, NJ 07971 


ARNE JENSEN 
Institute of Mathematical 
Statistics and 

Operations Research 

The Technical University 
f Denmark 


o! 
Lyngby, Denmark 


LAVEEN KANAL 

. N. K. Corporation 

302 Notley Court 

Silver Spring, MD 20904 


ASA KASHER 
Department of Philosophy 
Tel-Aviv University 
Tel-Aviv 69978, Israel 


TOSIO KITAGAWA 
Faculty of Science 
University of Kyushu 
Fukuoka, Japan 


DEMETRIOS G. LAINIOTIS 
Department of Electrical 
Engineering 

State University of 

New York at Buffalo 

Buffalo, NY 14214 


ROBERT LATTES 
Banque de Paris 
et des Pays-Bas 

3 rue d’Antin 

Paris 75002, France 


MIHAJLO D. MESAROVIC 
Systems Research Center 
Case Western 

Reserve University 

Cleveland, OH 44106 


AZRIEL ROSENFELD 
Computer Science Center 

University of Maryland 
College Park, MD 20740 


RICHARD C. SINGLETON 
Stanford 


Research Institute 
Menlo Park, CA 94025 


MICHAEL S. WATANABE 
Department of Physics 

and Astronomy 

University of Hawaii 
Honolulu, HI 96822 


BERNARD WIDROW 
Stanford University 
Stanford, CA 94305 


L. E. ZACHRISSON 
Institute for Optimization 
and Systems Theory 

The Royal Institute 

of Technology 
Stockholm 70, Sweden 


LOFTI ZADEH 
University of California 
Berkeley, CA 94720 





INFORMATION 
SCIENCES 


An International Journal 


Contents: 


Y. PERL and Y. BREITBART (Rehovot, Israel) 
Optimal Sequential Arrangement 
of Evaluation Trees for Boolean Functions 


YUTAKA TOMITA, SHIGERU OMATU and TAKASHI SOEDA (Tokushima, Japan) 
An Application of the Information Theory 
to Filtering Problems . 


JEFFREY A. HOFFER (Cleveland, OH) 
An Integer Programming Formulation 
of Computer Data Base Design Problems . 


Y. RUBINSTEIN and J. HAR-EL (Haifa, Israel) 
About One of Tsetlin’s Problems 
of the Collective Behavior of Stochastic Automata . 


J. S. MEDITCH (Irvine, CA) 
Initial- and Lagging-State Observers . 


JAMES EVANS, PAUL KERSTEN and LUDWIK KURZ (Brooklyn, NY) 
Robustized Recursive Estimation with Applications 


C. RAYMOND PERRAULT (Toronto, Canada) 
Augmented Transition Networks and 
Their Relation to Tree Transducers . 





© American Elsevier Publishing Company, Inc., 1976. All rights reserved. 





PAUL KERSTEN and LUDWIK KURZ (Brooklyn, NY) 
Robustized Vector Robbins-Monro Algorithm 
with Applications to.M-Interval Detection 


JACQUES MAURIN (Palaiseau, France) 
Random Functions with Given Time Correlation 


M. HOFRI and M. YADIN (Haifa, Israel) 
Multiprogramming with Virtual 
Memory—A Queueing Model . 


PETER A. NG (New York, NY) and s. y. BANG (Detroit, MI) 
Toward a Mathematical Theory 
of Graph-Generative Systems and its Applications . 


DAVID L. MILGRAM (College Park, MD) 
“Real-Time” Equivalence of 
Cellular Automata and Linear-Bounded Automata 


JOHN M. RICHARDSON and RAYMOND E. GALLAGHER (Anaheim, CA) 
Linear Minimal Variance Estimation 
in Target Detection and Location 


ROBERT B. ASHER (Colorado Springs, CO), 
CRAIG S. SIMS (Stillwater, OK) 
and HENRY R. SEBESTA (Arlington, TX) 
Optimal Open-Loop Feedback Control 
for Linear Systems with Unknown Parameters 


GORDON J. VANDERBRUG (College Park, MD) 
Problem Representations 
and Formal Properties of Heuristic Search 


P. PAPANTONI-KAZAKOS and D. KAZAKOS (Houston, TX) 
The Limiting Density of a Nonlinear System . 


SIMON HAYKIN (Hamilton, Ontario, Canada) 
and CHRIS HAWKES (Toronto, Ontario, Canada), 
Adaptive Digital Filtering for Coherent MTI Radar 


Author and Subject Indexes to Volume 11 








